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AMENDMENTS TO THE CLAIMS 

This listing of claims replaces all prior versions, and listings, of claims in the application: 
Listing of Claims: 

1. (Previously Presented) In a computer system that includes software under test, a 
method of verifying the software with one or more tunable test cases that are capable of being set 
to any of a plurality of verification levels, the method comprising acts of: 

reading in one or more test cases that include a plurality of software testing 
instructions organized as a plurality of verification levels within a verification hierarchy, 
wherein at least two verification levels within the verification hierarchy define different 
amounts of checking to perform for determining if the software functions as intended 
when executed; 

reading in verification settings that define one or more desired verification levels 
within the verification hierarchy; 

identifying a test group comprising a plurality of test cases including at least one 
of the one or more test cases having software testing instructions that corresponds to the 
one or more desired verification levels; 

running a test on the software with all of the plurality of test cases within the test 
group by running the software testing instructions corresponding to the one or more 
desired verification levels of each of the test cases in the test group; 

upon detecting an adverse or unexpected result from running the test, isolating the 
plurality of test cases within the test group and running each of the isolated test cases 
individually; and 

upon running each of the isolated test cases individually, determining which of 
the isolated test cases caused the adverse or unexpected result. 
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2. (Original) The method of claim 1, wherein a first test case from the one or more 
test cases is part of a first test group, the first test group including one or more software testing 
instructions organized as one or more verification levels within the verification hierarchy, and 
wherein the verification settings that define the one or more desired verification levels for the 
one or more test cases also define one or more desired verification levels for the first test group. 

3. (Original) The method of claim 2, further comprising acts of: 

identifying a portion of the one or more software testing instructions within the first test 
group that corresponds to the one or more desired verification levels; and 

running a portion of the first test group that corresponds to the one or more desired 
verification levels. 

4. (Original) The method of claim 3, wherein the verification settings define a single 
desired verification level for the first test case and the first test group. 

5. (Original) The method of claim 3, wherein the verification settings define a 
desired verification level for the first test case that is different from a desired verification level 
for the first test group. 

6. (Original) The method of claim 4, wherein a second test case from the one or 
more test cases is part of the first test group, and wherein the verification settings define a 
desired verification level for the second test case different from the desired verification level for 
the first test group. 

7. (Original) The method of claim 5, wherein a second test case from the one or 
more test cases is part of the first test group, and wherein the verification settings define a 
desired verification level for the second test case that is different from the desired verification 
level for the first test group. 
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8. (Original) The method of claim 7, wherein verification settings define a desired 
verification level for the second test case that is different from the desired verification level for 
the first test case. 

9. (Original) The method of claim 3, wherein a second test case from the one or 
more test cases is part of the first test group, and wherein third and fourth test cases from the one 
or more test cases are part of a second test group, the second test group including one or more 
software testing instructions organized as one or more verification levels within the verification 
hierarchy, and wherein the verification settings that define the one or more desired verification 
levels for the one or more test cases also define one or more desired verification levels for the 
second test group, the method further comprising acts of: 

identifying a portion of the one or more software testing instructions within the second 
test group that corresponds to the one or more desired verification levels; and 

running a portion of the second test group that corresponds to the one or more desired 
verification levels. 

10. (Original) The method of claim 9, wherein the verification settings define 
different desired verification levels for each of the first test case, the second test case, the third 
test case, the fourth test case, the first test group and the second test group. 

11. (Original) The method of claim 10, wherein the first and second test groups are 
part of a third test group, the third test group including one or more software testing instructions 
organized as one or more verification levels within the verification hierarchy, and wherein the 
verification settings that define the one or more desired verification levels for the one or more 
test cases also define one or more desired verification levels for the third test group, the method 
further comprising acts of: 

identifying a portion of the one or more software testing instructions within the third test 
group that corresponds to the one or more desired verification levels; and 
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running a portion of the third test group that corresponds to the one or more desired 
verification levels. 

12. (Original) The method of claim 11, wherein the verification settings define a 
desired verification level for the third test group different from each of the first test case, the 
second test case, the third test case, the fourth test case, the first test group and the second test 
group. 

13. (Original) The method of claim 1, wherein at least a portion of at least one of the 
plurality of software instructions determines that software information is available and uses the 
information for troubleshooting the software if it is determined that the software does not 
function as intended when executed. 

14. (Original) The method of claim 13, wherein the software information available is 
debug information. 

15. (Original) The method of claim 1, wherein the portion of the one or more test 
cases that corresponds to the one or more desired verification levels does not produce any testing 
output. 

16. (Original) The method of claim 1, wherein the portion of the one or more test 
cases that corresponds to the one or more desired verification levels produces one or more test 
outputs for verifying the software. 
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17. (Previously Presented) In a computer system that includes software under test, a 
method of verifying the software with one or more tunable test cases that are capable of being set 
to any of a plurality of verification levels, the method comprising steps for: 

loading one or more test cases that include a plurality of software testing 
instructions organized as a plurality of verification levels within a verification hierarchy, 
wherein at least two verification levels within the verification hierarchy define different 
amounts of testing to perform for determining if the software functions as intended when 
executed; 

receiving verification setting instructions for one or more desired verification 
levels from within the verification hierarchy for use in testing the software, wherein the 
received verification setting instructions select the one or more desired verification levels 
from a group of verification levels that include at least first and second verification 
levels, wherein selection of the first verification level causes the one or more test cases to 
be run during testing without producing any recorded output, and wherein selection of the 
second verification level causes the one or more test cases to be run during testing with 
recorded output; and 

testing the software at the one or more desired verification levels, which include 
at least one of the first and second verification levels, by running the one or more test 
cases that include the plurality of software testing instructions that correspond to the one 
or more desired verification levels. 
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18. (Original) The method of claim 17, wherein a first test case from the one or more 
test cases is part of a first test group, the first test group including one or more software testing 
instructions organized as one or more verification levels within the verification hierarchy, and 
wherein the verification setting instructions for the one or more desired verification levels define 
a desired verification level for the first test case different from a desired verification level for the 
first test group, further comprising acts of: 

identifying a portion of the one or more software testing instructions within the 
first test group that corresponds to the one or more desired verification levels; and 

running a portion of the first test group that corresponds to the one or more 
desired verification levels. 

19. (Original) The method of claim 18, wherein a second test case from the one or 
more test cases is part of the first test group, and wherein the verification setting instructions 
define a desired verification level for the second test case that is different from a desired 
verification level for the first test group. 

20. (Original) The method of claim 19, wherein verification setting instructions for 
the desired verification levels define a single verification level for the first and second test cases. 
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21. (Previously Presented) A computer program product comprising one or more 
computer readable storage media storing computer executable instructions that, when executed, 
implement the method recited in claim 1 . 



22. (Original) The computer program product of claim 21, wherein a first test case 
from the one or more test cases is part of a first test group, the first test group including one or 
more software testing instructions organized as one or more verification levels within the 
verification hierarchy, and wherein the verification settings that define the one or more desired 
verification levels for the one or more test cases also define one or more desired verification 
levels for the first test group. 

23. (Original) The computer program product of claim 22, wherein the verification 
settings define a single desired verification level for the first test case and the first test group, and 
wherein a second test case from the one or more test cases is part of the first test group, and 
wherein the verification settings define a desired verification level for the second test case 
different from a desired verification level for the first test group. 

24. (Original) The computer program product of claim 22, wherein a second test case 
from the one or more test cases is part of the first test group, and wherein third and fourth test 
cases from the one or more test cases are part of a second test group, the second test group 
including one or more software testing instructions organized as one or more verification levels 
within the verification hierarchy, and wherein the verification settings that define the one or 
more desired verification levels for the one or more test cases also define one or more desired 
verification levels for the second test group, and wherein the verification settings define different 
desired verification levels for each of the first test case, the second test case, the third test case, 
the fourth test case, the first test group and the second test group. 
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25. (Previously Presented) A computer program product comprising one or more 
computer readable storage media storing computer executable instructions that, when executed, 
implement the method recited in claim 17. 

26. (Original) The computer program product of claim 25, wherein a first test case 
from the one or more test cases is part of a first test group, the first test group including one or 
more software testing instructions organized as one or more verification levels within the 
verification hierarchy, and wherein the verification setting instructions for the one or more 
desired verification levels define one or more desired verification levels for both the first test 
case and the first test group. 

27. (Original) The computer program product of claim 26, further comprising acts of: 
identifying a portion of the one or more software testing instructions within the first test 

group that corresponds to the one or more desired verification levels; and 

running a portion of the first test group that corresponds to the one or more desired 
verification levels. 

28. (Original) The computer program product of claim 27, wherein the verification 
setting instructions define a single desired verification level for the first test case and the first test 
group. 

29. (Original) The computer program product of claim 27, wherein the verification 
setting instructions define a desired verification level for the first test case that is different from a 
desired verification level for the first test group. 

30. (Original) The computer program product of claim 28, wherein a second test case 
from the one or more test cases is part of the first test group, and wherein the verification setting 
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instructions define a desired verification level for the second test case that is different from the 
desired verification level for the first test group. 

3 1 . (Original) The computer program product of claim 29, wherein a second test case 
from the one or more test cases is part of the first test group, and wherein the verification setting 
instructions define a desired verification level for the second test case that is different from the 
desired verification level for the first test group. 

32. (Original) The computer program product of claim 31, wherein verification 
setting instructions define a desired verification level for the second test case that is different 
from the desired verification level for the first test case. 
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33. (Original) The computer program product of claim 27, wherein a second test case 
from the one or more test cases is part of the first test group, and wherein third and fourth test 
cases from the one or more test cases are part of a second test group, the second test group 
including one or more software testing instructions organized as one or more verification levels 
within the verification hierarchy, and wherein the verification setting instructions that define the 
one or more desired verification levels for the one or more test cases also define one or more 
desired verification levels for the second test group, the method further comprising acts of: 

identifying a portion of the one or more software testing instructions within the 
second test group that corresponds to the one or more desired verification levels; and 

running a portion of the second test group that corresponds to the one or more 
desired verification levels. 

34. (Original) The computer program product of claim 33, wherein the verification 
setting instructions define different desired verification levels for each of the first test case, the 
second test case, the third test case, thee fourth test case, the first test group and the second test 
group. 

35. (Original) The computer program product of claim 34, wherein the first and 
second test groups are part of a third test group, the third test group including one or more 
software testing instructions organized as one or more verification levels within the verification 
hierarchy, and wherein the verification setting instructions that define the one or more desired 
verification levels for the one or more test cases also define one or more desired verification 
levels for the third test group, the method further comprising acts of: 

identifying a portion of the one or more software testing instructions within the third test 
group that corresponds to the one or more desired verification levels; and 

running a portion of the third test group that corresponds to the one or more desired 
verification levels. 
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36. (Original) The computer program product of claim 35, wherein the verification 
setting instructions define a desired verification level for the third test group that is different 
from the each of the first test case, the second test case, the third test case, the fourth test case, 
the first test group and the second test group. 

37. (Original) The computer program product of claim 25, wherein at least a portion 
of at least one of the plurality of software instructions determines that software information is 
available and uses the information for troubleshooting the software when it is determined that the 
software does not function as intended when executed. 

38. (Currently Amended) The method computer program product of claim 4737, 
wherein the software information available is debug information. 

39. (Original) The computer program product of claim 25, wherein the portion of the 
plurality of software testing instructions that corresponds to the one or more desired verification 
levels does not produce any testing output. 

40. (Original) The computer program product of claim 25, wherein the portion of the 
plurality of software testing instructions that corresponds to the one or more desired verification 
levels produces one or more test outputs used to verify the software functions as intended. 

41. (Previously Presented) A method as recited in claim 17, wherein the 
method further includes an act of automatically detecting a development stage that the software 
is being tested in during the test and for gathering information for at least additional testing or 
debugging based upon the detected development stage. 
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